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ABSTRACT 



This invention provides a color still image sensing apparatus 
and method, which can obtain image quality as high as that 
of the three-plate type with cost as low as the single-plate 
type, and can prevent the input time from becoming redun- 
dant. A solid-state image sensing device, which has an image 
sensing surface made up of a large number of photoelectric 
conversion elements arranged in a matrix and to the front 
surface of the image sensing surface of which a color filter 
having different color component regions in correspondence 
with the arrangement intervals of photoelectric conversion 
elements is fixed, is used, the irradiation region of incident 
light with respect to the solid-state image sensing device is 
changed in units of arrangement intervals of the photoelec- 
tric conversion elements by displacing the solid-state image 
sensing device and the incident light with respect to the 
solid-state image sensing device relative to each other along 
the image sensing surface in units of arrangement intervals 
of the photoelectric conversion elements, and image data of 
the solid-state image sensing device sensed at a plurality of a 
changed positions are synthesized to an image. 

11 Claims, 7 Drawing Sheets 
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STORE SENSED IMAGE IN FIRST 
MEMORY OF DATA STORAGE 
DEVICE (x-Y COORDINATE 
POSITION (0, 0)) 




MOVE CCD ELEMENT TO 
COORD xNATE POSITION (0,1) 

AND STORE IMAGE SENSED THERE 
IN SECOND MEMORY 
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MOVE CCD ELEMENT TO 
COORDINATE POSITION (1,0) 
AND STORE IMAGE SENSED THERE 
IN THIRD MEMORY 
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MOVE CCD ELEMENT TO 
COORDINATE POSITION (1,1) 
AND STORE IMAGE SENSED THERE 
IN FOURTH MEMORY 



8 2 



DSP READS OUT FOUR PIECES OF 
IMAGE INFORMATION STORED IN 
DATA STORAGE DEVICE, 
SYNTHESIZES THEM INTO SINGLE 
IMAGE, AND OUTPUTS IMAGE TO 
EXTERNAL DEVICE 
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COLOR STILL IMAGE SENSING 
APPARATUS AND METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to a color still image sensing 5 
apparatus and method using a solid-state image sensing 
device. 

Conventionally, the following color image sensing appa- 
ratus systems using solid-state image sensing devices such ^ 
as a CCD (Charge Coupled Device), and the like are 
available. 

(1) Three-plate Type Color Camera 

Incident light is separated into three primary colors with 
an optical system (prism), and the separated three compo- 15 
nents of colors are respectively received with three solid- 
state image sensing devices. With the three-plate type color 
camera, since the three color components can be extracted at 
the same time, and an independent processing system is used 
for each color component, ideal image sensing characteris- 20 
tics can be obtained. 

However, with this type of color camera, three solid-state 
image sensing devices are required, the color-separation 
optical system is complex, and the three solid-state image 
sensing devices require high attachment precision, resulting 25 
in an expensive system. 

(2) Single-plate Type Color Camera 

In a camera of this type, color filters are attached to the 
individual pixels (photoelectric conversion elements) of a 30 
solid-state image sensing device to obtain color information 
from a single solid-state image sensing device. The color 
filters normally used have a mosaic or stripe pattern in which 
primary colors or complementary colors are arranged in 
correspondence with the individual pixels. In this single- 35 
plate type color camera, no special color-separation optical 
system is required unlike in the three-plate type, and only 
one solid-state image sensing device is required, resulting in 
an inexpensive system. 

However, since information extracted from one pixel 40 
pertains to a single color, and insufficient color information 
is compensated for using information of the neighboring 
pixels, such compensation may cause production of false 
colors (moire) or a low resolution. 

(3) Color Filter Switching Single-plate Type Color Cam- 45 
era 

In this camera, a single solid-state image sensing device 
is used, and color filters inserted in the optical path from the 
object to the solid-state image sensing device are switched 
in turn in synchronism with the charge transfer timings of 50 
the solid-state image sensing device, thereby extracting 
color information. A color still image is obtained by accu- 
mulating and synthesizing the extracted color information. 
In this case, a technique of improving the resolution by a 
pixel shift method is available (Japanese Patent Laid-Open 55 
No. 6-181546). 

In this color filter switching type, image quality as high as 
that of the three-plate type can be obtained by a single plate. 
However, since relatively large color filters are, for example, 6Q 
rotated to sequentially convert the colors of light entering 
the solid-state image sensing device, image sensing input 
requires a long time, and the apparatus becomes bulky 

SUMMARY OF THE INVENTION 

65 

The present invention has been made in consideration of 
the above situation, and has as its object to provide a color 
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still image sensing apparatus and method, which can obtain 
image quality as high as a three-plate type with cost as low 
as a single-plate type, and can prevent the input time from 
becoming redundant. 

In order to achieve the above object, a color still image 
sensing apparatus according to the present invention is 
characterized by a solid-state image sensing device having 
an image sensing surface made up of a large number of 
photoelectric conversion elements arranged in a matrix, a 
color filter fixed to a front surface of the image sensing 
surface of the solid-state image sensing device and having 
different color component regions in correspondence with 
arrangement intervals of the photoelectric conversion 
elements, driving means for displacing the solid-state image 
sensing device and incident light with respect to the solid- 
state image sensing device relative to each other along the 
image sensing surface in units of arrangement intervals of 
the photoelectric conversion elements so as to change an 
irradiation position of the incident light with respect to the 
solid-state image sensing device, storage means for record- 
ing image data of the solid-state image sensing device 
sensed at a plurality of positions corresponding to the 
irradiation positions changed by the driving means, and 
processing means for reading out the image data stored in 
the storage means and synthesizing the readout image data 
into an image. 

Preferably, the driving means is adapted to displace the 
solid-state image sensing device and the incident light a 
plurality of number of times, so that an irradiation region of 
the incident light having a size corresponding to a size of the 
photoelectric conversion element moves to all types of 
adjacent color component regions of the color filter of the 
solid-state image sensing device. 

In order to further improve the resolution, the driving 
means is adapted to displace the solid-state image sensing 
device and the incident light relative to each other by % of 
the arrangement interval of the photoelectric conversion 
element, and displaces the solid-state image sensing device 
and the incident light relative to each other therefrom in 
units of arrangement intervals of the photoelectric conver- 
sion elements so as to change the irradiation position of the 
incident light with respect to the solid-state image sensing 
device. 

As a preferred arrangement, the driving means has a 
support device for supporting the fixed image sensing device 
to be movable in a first direction and a second direction 
which makes a right angle with the first direction, and the 
support device has first and second plate members each of 
which has a support plate portion which defines a surface 
perpendicular to an optical axis of the incident light, upright 
portions formed at right angles on both sides of the support 
plate portion, and attachment plate portions formed at end 
portions of the upright portions on both sides, and extending 
parallel to the support plate portion, and is integrally formed 
by bending a thin plate having elasticity. Rigidity in bending 
of the first and second plate members is preferably reduced 
at bent portions. 

Also, in order to achieve the above object, a color still 
image sensing method according to the present invention is 
characterized by using a solid-state image sensing device 
which has an image sensing surface made up of a large 
number of photoelectric conversion elements arranged in a 
matrix, and to a front surface of the image sensing surface 
of which a color filter having different color component 
regions in correspondence with arrangement intervals of the 
photoelectric conversion elements is fixed, and changing an 
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irradiation position of incident light with respect to the conversion elements are fixed, only one color information 

solid-state image sensing device by displacing the solid-state per image sensing can be extracted from a single photoelec- 

image sensing device and the incident light with respect to trie conversion device. 

the solid-state image sensing device relative to each other Incident light coming from the lens system of the camera 

along the image sensing surface in units of arrangement 5 is irradiated onto the entire image sensing surface of the 

intervals of the photoelectric conversion elements, and syn- solid-state image sensing device. For example, a certain 

thesizing image data of the solid-state image sensing device point W on the image sensing surface irradiated with the 

sensed at a plurality of changed positions into an image. incident light will be examined below. Assume that the 

BRIEF DESCRIPTION OF THE DRAWINGS coordinate position of the point W on the solid-state image 

30 sensing device in FIG. 4(a) is defined as (0, 0). When the 

FIG. 1 is an exploded perspective view of a principal part solid-state image sensing device is shifted downward from 

of an image sensing camera according to the present inven- the state shown in FIG. 4(a) accurately by one pixel 

tlon i (corresponding to the arrangement interval of the photoelec- 

FIG. 2 is a partially cutaway perspective view of the trie conversion elements) on an X-Y coordinate system in 

image sensing camera according to the present invention and is the image sensing surface, the point W moves to a coordi- 

shows its internal structure; nate position (0, 1) on the solid-state image sensing device, 

FIG. 3 is a perspective view of an X-Y support device that as shown in FIG. 4(b). 

shows a state wherein X- and Y-axis plate members accord- That is, the filter color at the coordinate position (0, 0) on 

ing to the present invention are combined; the solid-state image sensing device is G, but the filter color 

FIG. 4 is an explanatory view of the principle of the 20 at the coordinate position (0, 1) is B. For this reason, when 

present invention; image sensing is done respectively at the two coordinate 

FIG. 5 is a block diagram showing the overall apparatus positions (0, 0) and (0, 1), information of two color corn- 
corresponding to an image sensing apparatus according to ponents (G, B) can be extracted in correspondence with the 
the present invention; 25 P°i nt w - 

FIG. 6 is a control flow chart of the apparatus shown in Likewise, when the solid-state image sensing device is 

FIG 5* and shifted to the left to move the point W to a coordinate 

FIG.' 7 is an explanatory view of a technique that applies P° sition (1 ! °\ th / filter ? oloT a ! . that P osi f tion is . R ' and j f 

a pixel shift method to the present invention. ^ ^ ns A ^ 15 J*?, at u mat P 05 * 011 / ^^Uon can be 

obtained. Alter all, all the required three color components 

DESCRIPTION OF THE PREFERRED 30 (R, G, B) at the point W can be extracted by executing image 

EMBODIMENTS sensing at the coordinate positions (0, 0), (0, 1), and (1, 0). 

An embodiment of the present invention will be described On the other hand, in this color filter 11, in order to obtain 

in detail hereinafter with reference to the accompanying three color components at, for example, a point V in FIG. 

drawings. 35 4(a), image sensing must be done at coordinate positions (0, 

FIG. 4 is an explanatory view of the principle of the °)» (°» x )> and 0-* *) m relation of the color arrangement, 

present invention. FIG. 4 partially shows a color filter 11, Hence, in this example of the color filter 11, when image 

and a large number of squares illustrated in the figure sensing is done respectively at the coordinate positions (0, 

respectively represent color component regions 12 of the 0), (0, 1), (1, 0), and (1, 1), all the color components for all 

color filter 11. In these color component regions 12, three 40 tne pixels can be obtained by a total of four image sensing 

primary colors, i.e. R, G, and B filters, are set in a mosaic operations. 

pattern. The color arrangement of the filters in this technique Note that the above-mentioned color filter arrangement of 

is a so-called Bayer arrangement in which rows including the solid-state image sensing device is merely an example 

alternating G and R components and rows including alter- for descriptive purposes, and all the color components for all 

nating B and G components are alternately arranged so that 45 the pixels can be obtained by appropriately selecting the 

G components form a checkerboard pattern. In this moving directions, distances, order, the number of times, 

connection, it is generally known that the resolution can be and the like of the solid-state image sensing device in 

improved by increasing the number of G signals. correspondence with the color arrangement of the color 

A solid-state image sensing device (not shown in FIG. 4) filter, 

is located behind the color filter 11. The solid-state image 50 In this manner, when the solid-state image sensing device 

sensing device comprises, e.g. a CCD, and has an image having the color filter is moved relative to incident light and 

sensing surface made up of a large number of photodiodes image data sensed at a plurality of positions are synthesized, 

as photoelectric conversion elements that serve as pixels a color still image with a high resolution can be obtained 

arranged in a matrix (e.g., 250 thousand photodiodes at even by a relatively small number of pixels of the solid-state 

arrangement intervals of 7 //m). The color filter 11 is fixed 55 image sensing device. 

to the front surface of the image sensing surface. The An example of an image sensing apparatus of the present 

individual color component regions 12 of the color filter 11 invention will be explained below. FIG. 1 is an exploded 

are arranged to oppose the photoelectric conversion ele- perspective view of the principal part of an image sensing 

mentsof the fixed image sensing device to have a one-to-one camera according to the present invention, and FIG. 2 is a 

correspondence therebetween, and each photoelectric con- 60 partially cutaway perspective view of the image sensing 

version element receives incident light that has been trans- camera according to the present invention to show its 

mitted through the filter in the opposing color component internal structure. 

region. The color filter 11 and the solid-state image sensing As shown in FIG. 2, this image sensing camera 21 has a 

device are aligned and attached to the focal point position of lens system 23 on a front surface portion of a housing 22, 

a lens system (not shown) of a camera. 65 and a base plate 24 that supports a CCD (not shown in FIG. 

In such a solid-state image sensing device, since the 2) at the focal point position of the lens system 23 is 

colors of the filters attached to the individual photoelectric arranged in the housing 22. The base plate 24 is fixed to the 
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housing 22 by screws 25, and the CCD is mounted on the the X-axis plate member 35, and extends parallel thereto, 

plate 24 via a CCD driving device 26 as a driving means for Upon bending at the bent portions, the support plate portion 

changing the irradiation position of incident light. 45 of the Y-axis plate member 36 can be elastically displaced 

Furthermore, a main circuit board 27 is fixed in the in the Y-axis direction (the vertical direction in FIG. 1) as a 

housing 22, and performs predetermined control, A power 5 second direction that makes a right angle with the X-axis 

switch 28, mode selection switch 29, external power supply while maintaining a nearly parallel state with respect to the 

jack 30, signal input/output terminal 31, and the like, which support plate portion 37 of the X-axis plate member 35. 

are operated by the camera operator, are arranged on the rear Hence, by synthesizing the movements of the two support 

surface of the housing 22 as in a normal image sensing plate portions 37 and 45, the support plate portion 45 of the 

camera. io Y-axis plate member 36 can move within the X-Y plane (in 

As shown in FIG. 1, a rectangular window portion 32 is a P lane perpendicular to incident light) with respect to the 

opened in the central portion of the base plate 24, and is ^ase plate 24. 

aligned and fixed so that incident light coming from the lens Since the X-Y support device 34 is built by the X- and 

system 23 passes through the window portion 32. Also, a Y-axis plate members 35 and 36, a support device that 

CCD 33 is arranged to face the window portion 32 so as to 15 operates accurately with a simple arrangement can be 

receive incident light. The CCD 33 is supported by an X-Y obtained. 

support device 34. The X-Y support device 34 has X- and Screw attachment holes 52 are opened in the four corners 

Y-axis plate members 35 and 36 which respectively serve as of the support plate portion 45 of the Y-axis plate member 

first and second plate members. 36, and an X-Y moving plate 53 is fixed to the support plate 

The X-axis plate member 35 has a support plate portion 20 portion 45 by screws 54 using these screw attachment holes 

37 having a surface perpendicular to the optical axis of 52. A window portion 55 is opened in the center of the X-Y 

incident light, upright portions 38 formed at right angles on moving plate 53, and the CCD 33 is fixed there. The CCD 

both sides of the support member 37, and attachment plate 33 is attached to a circuit board 56 via a CCD aligning plate 

portions 39 formed at the end portions of the two upright 57, and is fixed to the X-Y moving plate 53 by screws 59 

portions 38 and extending parallel to the support plate 25 using screw attachment holes 58 formed in the circuit board 

portion 37, and is integrally formed by bending a metal thin 56 and the CCD aligning plate 57. 

plate of, for example, stainless steel or the like, having Note that the CCD 33 as the solid-state image sensing 

elasticity. A rectangular window portion 40 through which device has an image sensing surface made up of a large 

incident light coming from the lens system 23 passes is number of photoelectric conversion elements in a matrix in 

opened in the center of the support member 37. Slits 41 and 30 the above-mentioned X- and Y-axis directions, and the color 

42 are respectively formed at bent portions as boundaries filter 11 shown in FIG. 4 is fixed to the image sensing 

between the support plate portion 37 and the upright por- surface. In the state wherein the CCD 33 is fixed to the X-Y 

tions 38, and at bent portions as boundaries between the moving plate 53, the position of the CCD is adjusted by the 

upright portions 38 and the attachment plate portions 39. CCD aligning plate 57 so that the X-Y directions of the 

Two screw attachment holes 43 are opened in each of the 35 image sensing surface agree with those of the X-Y support 

attachment plate portions 39 on both sides, and the X-axis device 34, and the image sensing surface of the CCD 33 is 

plate member 35 is fixed to the base plate 24 by screws 44 located at a predetermined position with respect to incident 

using these screw attachment holes 43. light. 

Note that a means for reducing rigidity in bending at each 4Q X- and Y-axis engaging arms 60 and 61 are respectively 

bent portion may comprise a plurality of small holes sue- formed on the side and lower portions of the X-Y moving 

cessively formed at the bent portion in the plate of the plate 53. X- and Y-axis driving portions 62 and 63 are 

above-mentioned slit. formed on the base plate 24 in correspondence with these 

In the state wherein the attachment plate portions 39 are arms. The X-axis driving portion 62 has a support member 

fixed to the base plate 24, the support plate portion 37 is 45 64 fixed to the base plate 24, a displacement amplification 

separated by a predetermined distance from the base plate 24 angle 65 made up of a spring member, and an X-axis 

and extends parallel thereto. Since the slits 41 and 42 are piezoelectric element 66 which is displaced in the X-axis 

formed at the bent portions, the rigidity in bending at the direction. 

bent portions is reduced. Upon bending at the bent portions, The displacement amplification angle 65 has a fulcrum 

the support member 37 can be elastically displaced in the 50 portion 68 fixed to the support member 64 by a screw 67, an 

X-axis direction (horizontal direction in FIG. 1) as a first intermediate arm portion 69, and an engaging portion 70 

direction while maintaining a nearly parallel state with formed at the distal end of the intermediate arm portion 69. 

respect to the base plate 24. The X-axis engaging arm 60 of the X-Y moving plate 53 fits 

Likewise, the Y-axis plate member 36 of the X-Y support into a hole 71 opened in the distal end of the engaging 

device 34 has a support plate portion 45, upright portions 46, 55 portion 70, thus determining its position, 

attachment plate portions 47, window portion 358, and slits The X-axis piezoelectric element 66 is attached while 

49 and 50, has a similar shape smaller than the X-axis plate being clamped between the support member 64 and the 

member 35, and is formed by bending a thin plate. As shown intermediate arm portion 69 under pressure. A leaf spring 85 

in FIG. 3, which illustrates the state wherein the X- and is formed at the distal end of the fulcrum portion 68 of the 

Y-axis plate members 35 and 36 are combined, the Y-axis 60 displacement amplification angle 65, and upon attachment 

plate member 36 is fixed to the support plate portion 37 of of the X-axis piezoelectric element 66, the leaf spring 85 

the X-axis plate member 35 using screw attachment holes 51 presses the intermediate arm portion 69 against the X-axis 

to be fitted into the U-shaped section of the member 35. piezoelectric element 66. 

In the state wherein the attachment plate portions 47 are The X-axis piezoelectric element 66 is connected to a 

fixed to the X-axis plate member 35, the support plate 65 driver circuit device (not shown), and is displaced upon 

portion 45 of the Y-axis plate member 36 is separated by a application of a voltage at a predetermined timing. When the 

predetermined distance from the support plate portion 37 of X-axis piezoelectric element 66 is displaced, its movement 
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is amplified by the displacement amplification angle 65 and stored in a first memory of the data storage device 77. In step 

is transmitted to the X-axis engaging arm 60, thereby 80, image data sensed at an X-Y coordinate position (0, 1) 

moving the X-Y moving plate 53, i.e. the CCD 33, in the is stored in a second memory of the data storage device 77. 

X-axis direction. By changing the applied voltage, the In step 81, image data sensed at an X-Y coordinate position 

moving amount of the CCD 33 can be adjusted. These 5 (1,0) is stored in a third memory of the data storage device 

control operations can be attained using a known means. 77. In step 82, image data sensed at an X-Y coordinate 

The Y-axis driving portion 63 has an arrangement similar position (1, 1) is stored in a fourth memory of the data 

to that of the X-axis driving portion 62, and has a support storage device 77. Finally, in step 83, the DSP 78 reads out 

member 72, a displacement amplification angle 73, and a image data from the first to fourth memories, synthesizes 

Y-axis piezoelectric element 74 which is displaced in the 10 them into a single image, and outputs the image. 

Y-axis direction. When a voltage is applied to the Y-axis In this manner, by synthesizing image data sensed at a 

piezoelectric element 74 at a predetermined timing, the X-Y plurality of positions, a color still image with a high reso- 

plate 53, i.e. the CCD 33, can be moved in the Y-axis lution can be obtained even by a relatively small number of 

direction. pixels of the solid-state image sensing device. In the case of 

Note that the CCD 33 must be moved in units of arrange- 15 this example, since image data of the three primary colors 

ment intervals of the photoelectric conversion elements are obtained for all the pixels, a resolution three times that 

upon driving the piezoelectric elements 66 and 74. In this of a conventional solid-state image sensing device having a 

case, calibration between the voltages (driving voltages) to color filter can be achieved. 

be applied to the piezoelectric elements 66 and 74 and the As a conventional scheme for increasing the resolution of 

moving distances of the CCD 33 can be easily attained using 20 a solid-state image sensing device, a pixel shift method is 

moireTringes appearing on a television monitor upon sensing known. The resolution of a solid-state image sensing device 

an image of, for example, a test pattern. such as a CCD or the like is determined by the number of 

For example, a black vertical stripe pattern and horizontal pixels, and in order to increase the resolution of the solid- 
stripe pattern are drawn on a resolution chart to measure the state image sensing device itself, pixels must be arranged at 
resolution, and the thicknesses and intervals of the indi- 25 high density. For this reason, the increase in resolution by 
vidua! stripes are gradually narrowed. Upon focusing on this improving the element itself is limited. In view of this 
chart, since false colors as the above-mentioned defect of the problem, the pixel shift method is proposed as a conven- 
single-plate type are produced at the boundary portions tional technique for increasing the resolution of a solid-state 
between black and white, another stripe pattern as an alter- image sensing device with a limited number of pixels. In this 
nate pattern of red and blue appears at the overlapping 30 method, image sensing is done not only at an original 
position with the stripe patterns. The false color stripe position of the solid -state image sensing device but also at 
pattern is easy to see since it has a larger thickness and a position obtained by shifting the relative position between 
intervals than those of the stripes of the test patterns, and the the solid-state image sensing device and incident light by, 
moving amount upon moving the CCD can be easily con- for example, X A the pixel pitch (the arrangement interval of 
firmed since it is similarly larger. 35 photoelectric conversion element) to extract information 

Upon performing adjustment in the X-direction, the driv- also from a space where no pixel is present in practice, and 

ing voltage is adjusted while observing the false color that information is inserted into an original image, thereby 

position appearing on the vertical stripe pattern. Strictly improving the resolution. If the number of sampling points 

speaking, the false color position is not a position with 4Q is increased by setting the shift amount to be VS, Vi, . . . , of 

respect to the monitor but a relative position with respect to the pixel pitch, finer space information can be obtained 

the vertical stripe pattern is observed. If red and blue replace although it also depends on the relationship with the pho- 

each other before and after movement, the moving amount tosensitive range per pixel of the element, 

just equals one pixel. Adjustment in the Y-direction can be When this pixel shift method is applied to the present 

similarly attained using the horizontal stripe pattern. 45 invention, an image with higher resolution can be obtained. 

Note that the test chart used in such adjustment is not FIG. 7 is an explanatory view of an example that applies the 

limited to the resolution chart, but any other patterns may be pixel shift method to the present invention, 

used as long as false colors which are properly easy to see In FIG. 7, squares represent pixels 84 of a solid-state 

appear. image sensing device. Let C be the central point of a certain 

FIG. 5 is a block diagram showing the overall apparatus so pixel 84 located at the upper left corner, CI be the point 

corresponding to the above-mentioned image sensing moved from the point C by Vi the pixel pitch in the 

apparatus, and FIG. 6 is a control flow chart of the apparatus. X-direction, C2 be the point moved from the point C by Vt. 

As shown in FIG. 5, the CCD 33 photoelectrically converts the pixel pitch in the Y-direction, and C3 be the point moved 

image incident light and outputs signals to an A/D converter from the point C by Vi the pixel pitch in both the X- and 

75. The A/D converter 75 quantizes the signals the CCD 33 55 Y-directions. 

as image data, which are sequentially stored in a data storage In image sensing according to the present invention that 

device 77 as a storage means under the control of a system adopts pixel shift, when the center of the certain pixel 84 at 

control 76. A digital signal process (DSP) 78 as a processing the upper left corner is located at the point C, the solid-state 

means reads out the image data stored in the storage device image sensing device is moved, as described above, in units 

77, synthesizes them into a single image, and outputs the 60 of pixel pitches to have the point C as the center, and image 

image. On the other hand, the CCD driving device 26 sensing is at the four positions. Subsequently, the solid-state 

appropriately moves the CCD 33 in units of arrangement image sensing device is moved by half a pixel, so that the 

intervals of the pixels in accordance with commands from center of the certain pixel 84 at the upper left corner comes 

the system control 76. to the point CI, and the solid-state image sensing device is 

Movement and image sensing of the CCD 33 are done, as 65 similarly moved in units of pixel pitches to have that 

shown in, for example, FIG. 6. More specifically, in step 79, position as the center, as described above, so as to execute 

image data sensed at an X-Y coordinate position (0, 0) is image sensing at the four positions. Similarly, the solid-state 



02/18/2004, EAST Version: 1.4.1 



US 6,236,430 Bl 

9 10 

image sensing device is moved, so that the center comes to blue components of moire* fringes appearing on the fine 
the points C2 and C3, and the solid-state image sensing horizontal stripe pattern replace each other. If such opera- 
device is also moved in units of pixel pitches to have these tions are repeated in units of fields, the eyes of a human 
positions as the centers, so as to execute image sensing at the being can no longer perceive moire* although red and blue 
four positions. Finally, a total of 16 image data sensed as 5 components are in fact alternately displayed. At this time, 
described above are synthesized to obtain a single color still when the CCD read timing is also shifted by one pixel in 
image. units of fields, a high-resolution image signal can be 

Note that 16 image sensing operations are performed to obtained, 
obtain a single still image in this example. However, the As described above, the high-resolution still image cam- 
activation time of the piezoelectric element required for 10 era of the present invention can obtain a video signal which 
moving the solid-state image sensing device by a very small is completely free from moire* and has higher image quality 
amount is very short, and 16 image sensing operations can than the conventional apparatus without using any optical 
be completed within a very short period of time. low-pass filter or moire* removal circuit. 

By using the pixel shift method, high resolution can be In the above-description, in order to move the irradiation 

attained. In the example described above with reference to 15 position of incident light on the solid-state image sensing 

FIG. 7, a resolution equivalent to that obtained using three device, the solid-state image sensing device is moved, 

devices each having one million pixels can be obtained However, it is necessary to displace the solid-state image 

using a single solid-state image sensing device having 250 sensing device and incident light relative to each other in the 

thousand pixels. present invention, and incident light may be moved in place 

The high-resolution still image camera of the present 20 of the solid-state image sensing device. Such movement can 

invention has as its first objective to obtain a high-resolution be attained using, for example, a glass plate or the like, 

still image, but may be required to be used as a normal CCD More specifically, a transparent material such as a glass 

camera at video signal level. In this case, false colors (moire) plate or the like having a refractive index larger than that of 

are considered as a drawback and pose a problem. 25 air is supported to be independently and slightly pivotal 

Normally, since a mosaic color CCD camera cannot 25 about ^ x_ and Y " a xes, and is set in front of the CCD on 

accurately detect color tones in units of dots, false colors tne optical path, and by changing the tilt angle of the 

(moir6) are produced near high-frequency components transparent material, incident light is diffracted to change the 

included in an image. In order to prevent this, the image irradiation position. In this case, in order to largely deflect 

must be blurred to some extent before the CCD, i.e. high- 30 incident light by a small tilt angle, the thickness of the 

frequency components must be cut, and an optical low-pass transparent material can be increased, 

filter is normally used for that purpose. However, since such In the above-mentioned example, the color filter on which 

filter cannot completely remove moire, a moire removal R> G» and B components are arranged in a mosaic pattern is 

circuit as a combination of an edge detection circuit and a used. However, the color filter used in the present invention 

color signal suppression circuit is used. 35 is not limited to such specific filter. Various other combina- 

Since the high-resolution still image camera of the present ^ on& of G > and B filters arran g ed & a mosaic pattern are 

invention has as its first objective to obtain a high-resolution also ava i la ble, and the present invention can be applied to 

image, the high-frequency components of an image are various types of color filter arrays (CFAs) such as comple- 

important, and an optical low-pass filter cannot be used. mentary colors Cy, M, and Ye, those including white W, and 

Accordingly, when the high-resolution still image camera of 40 me 

the present invention operates in a normal resolution mode, Furthermore, the present invention can suitably use a 
the above-mentioned problem of false colors occurs. As one c °i° r filter on which R, G, and B components are arranged 
solution to this problem, in the normal resolution mode, an m turn in a stri P e pattern. In the case of the above-mentioned 
X-Y fine movement table is vibrated at least at one cycle mosaic pattern, the irradiation position of incident light must 
within one exposure time (e.g. Vfco sec) to cut high-frequency 45 be moved in both the X- and Y-directions. However, when 
components without using any optical low-pass filter, the stripe pattern is used, the irradiation position need only 
thereby solving the problem of false colors. However, in this be t moved in one direction to cross the stripe, thus simpli- 
method, if moire is to be completely removed, the image is fy in S the structure of the driving device, 
excessively blurred; if the effect is suppressed to that as low In the above description, the CCD has been exemplified 
as the optical low-pass filter, it is hard to control vibrations, 50 as the solid-state image sensing device. However, the 
and a moire removal circuit is required as in the conven- present invention is not limited to this. For example, the 
tional apparatus. present invention can be similarly applied to other devices 
According to the present invention, in order to solve this such as a M0S type image sensing device, a CPD (Charge 
problem, in the normal resolution mode, an X-Y fine move- Priming Devicen or priming transfer device), and the like, 
ment table is moved in units of fields so that the phase of 55 m tne above-mentioned example, the piezoelectric ele- 
moire* is reversed between the first and second fields, thereby ments are used as a driving source. Also, magnetostrictive 
preventing moire from being visually observed. The moving elements may be preferably used, and a linear motor such as 
direction of the table depends on the arrangement order of a plunger solenoid, a rotary motor, and a simple electro- 
colors on the color filter used. In the case of the color filter magnet may also be used. 

(R, G, B, G) in the above embodiment, it is appropriate to 60 In the above description, the image sensing surface has 

simultaneously move the table by one pixel in both the X- been exemplified as a plane. However, the image sensing 

and Y-directions, thus consequently moving the table surface made up of photoelectric conversion elements need 

obliquely. That is, as described above, when the table is not always be a plane. In some cases, the image sensing 

shifted by one pixel in the X-direction, the red and blue surface may be formed into a spherical surface, and relative 

components of moire* fringes appearing on the fine vertical 65 movements may be made within the spherical surface, 

stripe pattern replace each other, and when the table is As described above, according to the present invention, a 

further shifted by one pixel in the Y-direction, the red and solid-state image sensing device, which has an image sens- 
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ing surface made up of a large number of photoelectric . respect to the solid-state image sensing device relative 

conversion elements arranged in a matrix and to the front to each other along the image sensing surface either in 

surface of the image sensing surface of which a color filter the horizontal direction across a row or in the vertical 

having different color component regions in correspondence direction across a column, 

with the arrangement intervals of photoelectric conversion 5 wherein the driving means is configured to displace the 

elements is fixed, is used, the irradiation region of incident solid state image sensing device and the incident light 

light with respect to the solid-state image sensing device is with respect to the solid state image sensing device 

changed in units of arrangement intervals of the photoelec- relative to each other in relation of the color component 

trie conversion elements, and image data of the solid-state regions of the color filter until three different color 

image sensing device sensed at a plurality of changed 10 components are extracted. 

positions are image-synthesized to obtain a single color still 2. A color still image sensing apparatus according to claim 
image. For this reason, image quality as high as that of the 1, wherein the color component regions of said color filter 
three-plate type can be obtained with cost as low as that of are arranged in a mosaic pattern to have a size corresponding 
the single-plate type without increasing the number of to a size of the photoelectric conversion element, 
solid-state image sensing devices or the number of pixels, is 3. A color still image sensing apparatus according to claim 
and the input time can be prevented from becoming redun- 1, wherein the color component regions of said color filters 
dant. Furthermore, a moving image free from any moire can are arranged in a stripe pattern to have a width correspond- 
also be generated. ing to a width of the photoelectric conversion element. 

The present invention can assure a broad industrial appli- 4. A color still image sensing apparatus according to claim 

cation range, i.e. can be applied not only to recording of still 20 1, wherein said driving means moves said solid-state image 

images but also to recognition, discrimination, and the like sensing device relative to the incident light, 

of recorded images. 5 . A color still image sensing apparatus according to claim 

What is claimed is: 1, wherein said driving means displaces said solid-state 

1. A color still image sensing apparatus comprising: image sensing device and the incident light relative to each 

a solid-state image sensing device having an image sens- 25 omer by ^ of the arrangement interval of the photoelectric 

ing surface made up of a large number of photoelectric conversion element, and displaces said solid-state image 

conversion elements arranged in a matrix with rows of sensing device and the incident light relative to each other 

photoelectric conversion elements in a horizontal direc- therefrom in units of arrangement intervals of the photo- 

tion and columns of photoelectric conversion elements electric conversion elements so as to change the irradiation 

in a vertical direction; 30 position of the incident light with respect to said solid-state 

a color filter fixed to a front surface of the image sensing se^g device, 

surface of said solid-state image sensing device and 6. A color stiU image sensing apparatus according to claim 

having different color component regions in correspon- 16 ' wherein said processing means has a video signal 

dence with arrangement intervals of the photoelectric generation function of outputtmg a moving image in addi- 

conversion elements to form a matrix with rows of 35 tlon t0 s y nthesis of a sti11 ima g e » and the video signal 

color component regions in the horizontal direction and g enerat ">° function receives two different images sensed by 

columns of color component regions in the vertical displacing said sohd-state image sensing device and the 

direction* incident light in one or both of horizontal and vertical 

driving means for displacing said solid-state image sens- m ™ °f arran g ement ***** of said solid- 

ing device and an incident light with respect to said 40 Jf? ™ a ge sensing device, outputting a first image at a 

solid-state image sensing device relative to each other S ° f « J* ™ , \! nd 0UtpUtUn S a second ^ at a 

i iU • c r timing oi a second field, 

along the image sensing surface in units of arrangement - f * . 

intervals of the photoelectric conversion elements so as , '.Acolor stiU image sensing apparatus according to claim 

to change an irradiation position of the incident light M £ wh h er * m the . ""'flf s f cond a reli "™ship 

with respect to said solid-state image sensing device, 45 *«ebetween in which phases of moire fringes appearing 

the driving means displacing the solid-state image therem are opposite to each other, 

sensing device and the incident light intermittently at a . * h Acol( * stlU ™age sensing apparatus according to 

distance of one pixel, a half pixel, or a combination X > wl \ erem the «** f»« has three col ° r component regions 

thereof- ' srcen ' and blue - 

t ,. , . . 50 9. A color still image sensing apparatus according to claim 

storage means for recording unage data of said solid-state 12 wherein the ^ fi „ er h £ " ^ , J^pm* 

image sensing device sensed at a plurality of positions ions of red ^ Wue y P 

corresponding to the irradiation positions changed by in a Z*;n ; - * j- 

said driving means; and , A L still image sensing apparatus according to 

B , ' ' " . claim 13, wherein the color component regions in the color 

processing means for reading out the image data stored in 55 fi i ter are arranged so that rows including alternating green 

said storage means and synthesizing the readout image and red components and rows including alternating blue and 

data into a still image having pixels that each include gree n components are alternately arranged so that green 

components of all color information contained therein, components form a checkerboard pattern. 

wherein said driving means displaces said solid-state 11. A color still image sensing apparatus according to 

image sensing device and the incident light a plurality 6 0 claim 1, wherein the driving means is configured to displace 

of number of times, so that an irradiation region of the the solid state image sensing device and the incident light 

incident light having a size corresponding to a size of with respect to the solid state image sensing device relative 

the photoelectric conversion element moves to all types to each other to extract color components of four adjacent 

of adjacent color component regions of said color filter color component regions of the color filter arranged in a 

of said solid-state image sensing device, 65 square pattern. 

wherein the driving means is configured to displace the 

solid-state image sensing device and incident light with ***** 
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